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Abstract 

This article identifies 
concrete steps used at 
Argosy University/Orange 
County (Argosy or AUOC) to 
integrate assessment in daily 
institutional operations and 
utilize assessment data for 
educational and organizational 
improvements. Additionally, 
the article addresses the role 
of an institutional effectiveness 
committee in facilitating the 
development of an internally 
driven core process of inquiry 
to improve student learning. 
This process includes the use 
of an assessment template that 
is consistent across programs 
and all delivery media; 
the adoption of program 
outcomes, measures, and 
rubrics that are compliant with 
central staff directives; and the 
standardization of the campus- 
wide self-study process. 

Introduction 

Since the 1980s, political 
leaders, employers, and 
the public have expressed 



an unprecedented level 
of concern with the state 
of education in America 
(Carnegie Forum on Education 
and the Economy, 1986). 
School districts throughout 
the country have been rocked 
by disputes about curriculum, 
standards of achievement, and 
classroom methods (Ravitch, 
2000). Spurred by national 
concern about the quality of 
American education, states 
and local school districts 
have undertaken hundreds 
of reform efforts, addressing 
not only traditional topics 
such as curricular content, 
instructional methods, 
and teacher training, but 
also fundamental issues of 
organizational structure and 
accountability (Cuban, 2003). 
On January 8, 2002, to support 
this increased emphasis 
on schools' accountability. 
President George W. Bush 
signed into law the revised 
Elementary and Secondary 
Education Act, also known as 
No Child Left Behind (NCLB), 
the most significant federal 
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education policy initiative in 
a generation. This new law 
poses enormous educational 
challenges for states. It requires 
the states to adopt challenging 
academic content, to expand the 
scope and frequency of student 
testing, to raise the percentage 
of students proficient in reading 
and math, to demonstrate 
what they term "adequate 
yearly progress," and to bridge 
the test-score gap between 
advantaged and disadvantaged 
students (Education Commission 
of the States, 2002). Because of 
the critical importance of this 
initiative, the U.S. Department of 
Education provided substantial 
funds to improve the quality 
of assessment instruments and 
systems used by the states to 
measure the achievement of 
all students. According to the 
Department of Education, "by 
[Fiscal Year] 2004, states and 
other entities will have received 
nearly $1.2 billion in support for 
assessment" (U.S. Department of 
Education, 2003, p. 1). 

Similarly, in the early 1990s, 
the National Education Goals 
Panel established the first 
set of objectives for post- 
secondary accountability (Ewell, 
2002). Although a proposed 
national assessment has never 
materialized, "it helped stimulate 
useful thinking about how a 
large-scale, authentic assessment 
of collegiate learning might 
actually be deployed" (p. 20). 

One of the most comprehensive 
national efforts to measure 
student achievement is the 
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Collegiate Learning Assessment 
(CLA), which promotes a culture 
of evidence-based assessment in 
higher education (The Secretary 
of Education's Commission on 
the Future of Higher Education, 
2006). Administered to freshmen 
and seniors, the CLA allows for 
inter-institutional comparisons 
that convey institutional 
contributions to student 
learning. The National Forum 
on College-Level Learning is 
another attempt to provide 
the states with comparable 
assessment information (The 
Secretary of Education's 
Commission on the Future of 
Higher Education, 2006). Piloted 
in 2002 across several states, 
the study collected data on 
student learning using multiple 
assessment measures. Results 
from this study "allow states 
to identify best practices, 
providing information used in 
creating policy and programs 
that will improve the states' 
intellectual capital "(p. 23). Since 
the emergence of the student 
assessment movement in 
higher education, the number 
of institutions engaging in 
some form of assessment 
activity has steadily increased 
(Maki, 2004; Peterson & 

Vaughan, 2002). However, while 
there is an extensive body of 
descriptive information on 
various approaches to student 
assessment, there is little 
systematic evidence addressing 
the use of this information for 
educational and institutional 
improvements (Peterson & 
Vaughan, 2002). 



Evolution of the 
Scholarship of 
Assessment 

Although no one has 
officially dated the birth of the 
assessment movement in higher 
education, it is safe to propose 
that date as the First National 
Conference on Assessment in 
Higher Education in 1985 (Ewell, 
2002). During the conference, it 
was concluded that in order to 
promote high levels of student 
achievement, institutions need 
to set challenging academic 
standards, involve students in 
active learning environments, 
and provide prompt and useful 
feedback. This conclusion might 
have been overlooked except 
that it was supported by other 
voices (Ewell, 2002). 

One set of voices emanated 
from within the academy and 
focused on curricular content, 
pedagogy, and instructional 
reform. Increasingly, institutions 
across the country were 
characterizing themselves 
as learner-centered, a term 
that appeared in numerous 
college and university 
mission statements (Maki, 

2004). Learner-centered 
institutions "view students as 
active learners, creators of or 
contributors to knowledge and 
understanding, while at the 
same time reflecting on how 
well they are learning" (p. 10). 

As the result of this movement, 
faculty was urged to shift 
from a transmission-oriented 
pedagogy to an alternative 
educational philosophy known 
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as constructivism. Constructivism 
is based on the premise that 
understanding comes from a 
person's effortful activity to 
integrate newly communicated 
information with his or her own 
prior knowledge and beliefs 
(Becker, 2000). Consequently, 
a constructivist pedagogy 
attempts to make learning a 
more self-directed and socially 
mediated process in which 
learners' own motivations and 
efforts are considered central to 
their educational experiences. 

Learner-centered institutions 
also focus on how programs and 
services outside the academic 
departments contribute to, 
support, and complement the 
curriculum and, thereby, achieve 
the institutional mission (Maki, 
2004). Exploring how different 
complementary relationships 
contribute to learning enables 
an institution to understand the 
efficacy of these relationships in 
enhancing students' education 
(Maki, 2004). Consequently, 
assessing the content and the 
quality of students' education 
becomes an essential process in 
learner-centered institutions. 

A second set of voices arose 
simultaneously outside the 
academy. These consisted largely 
of federal, state, and regional 
calls for accountability, which, 
in some cases, also had funding 
or accreditation implications 
(Ewell, 2002). These external 
stimuli were largely responsible 
for a steady upward trend in 
the number of institutions 
reporting involvement with 



assessment (Ewell, 2002; Wright, 
2002). The explosive growth 
of the assessment movement 
has prompted accrediting 
associations to revise their 
procedures for institutional 
accountability. For instance, 
the North Central Association 
(NCA) of Colleges and Schools 
launched its Academic Quality 
Improvement Project to make 
accreditation a more powerful 
force by combining the 
continuous quality improvement 
principles of prominent thinkers 
with the accreditation process. 
Furthermore, an Associate 
Director of the NCA, Cecilia 
Lopez, conducted a study of 
432 team reports to determine 
the progress made by member 
institutions in implementing 
effective assessment programs 
(Wright, 2002). Lopez (1999) 
concluded that "many 
[institutions] have yet to realize 
a level of ongoing assessment 
that could position them to 
become a student-centered 
learning organization committed 
to continuous improvement" 
(p.42). 

Despite these advances, after 
a decade and a half, the student 
assessment revolution in higher 
education is far from complete. 
Peterson and Vaughan (2002) 
suggest that "whether student 
assessment makes a difference 
at the institutional level is still 
an unanswered question" (p. 45). 
However, the institutions are 
beyond the question of whether 
assessment should exist and are 
asking how they can incorporate 



better methodology and yield 
greater benefits for students 
and society (Erwin & Wise, 

2002). Consequently, continuing 
scholarship aimed at developing 
appropriate responses to 
periodic accountability demands 
will always be needed (Ewell, 
2002). 

Site Description 

This article describes the 
evolution of the assessment 
culture at Argosy, a private 
for-profit university with 1 1 
campuses in 1 1 states. There are 
11 main campuses, seven branch 
campuses, and six limited-service 
sites with the home campus and 
central administration located 
in Chicago, Illinois. Argosy 
University is a wholly owned 
subsidiary of the Education 
Management Corporation. 
Through its four colleges. Argosy 
offers professional programs at 
the undergraduate, graduate, 
and post-graduate levels in 
psychology, behavioral sciences, 
business, education, and health 
sciences. These programs provide 
educational opportunities 
for working adults through 
flexible delivery formats and an 
amalgam of distance learning 
and intensive on-campus study 
periods (AUOC, 2004). 

Argosy University is accredited 
by the Higher Learning 
Commission of the North 
Central Association (NCA) of 
Colleges and Schools. The 
assessment matrix provided 
by the Commission depicts 
three levels of implementation 
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signifying institutional progress 
in developing its assessment 
culture (The Higher Learning 
Commission, 2003). The first 
level is characterized by the 
lack of the overall strategies 
used in conducting an effective 
assessment program. The 
second level indicates that an 
institution has developed a 
shared understanding of the 
purposes, advantages, and 
limitations of its assessment 
practice but has yet to extend 
it to all academic programs. 

The third level of maturation 
requires an institution to 
integrate assessment in its daily 
operations and utilize student 
assessment data for educational 
and institutional improvements 
(The Higher Learning 
Commission, 2003). 

In the attempt to achieve 
an externally validated Higher 
Learning Commission level 
three culture of assessment 
and continuous improvement, 
an Institutional Effectiveness 
Committee composed of 
multidisciplinary representation 
was formed by the AUOC 
president. The purpose of the 
committee was to establish and 
disseminate standards, tools, 
and processes for campus-wide 
assessment and continuous 
improvement that would be 
synchronized with the Argosy 
system. Moreover, the committee 
was responsible for evaluating 
and refining department and 
institutional effectiveness review 
procedures, thus providing an 
oversight of the campus-wide 
self-study process. 



Assessment 

Infrastructure 

Key to the assessment 
infrastructure at AUOC was 
the development of program 
learning outcomes. According 
to Nichols and Nichols (2000), 
program learning outcomes are 
"descriptions of what academic 
departments intend for students 
to know (cognitive), think 
(attitudinal), and do (behavioral) 
when they have completed 
their degree programs, as well 
as their general education or 
core curricula" (p. 17).Though 
all program outcomes were 
developed using similar 
standards, the participants 
varied based on the needs 
of each program or campus 
(AUOC, 2004). For instance, 
the outcomes for programs 
taught at the national level 
were developed as a part of 
a University-wide process. 
Conversely, the development 
of the outcomes for the single- 
campus programs, including the 
general education component 
of the undergraduate programs, 
involved numerous consultations 
between the program chairs at 
local campuses and the central 
academic affairs personnel. 

The second component of 
Argosy's assessment plan was 
the adaptation of the five- 
column model of assessment 
for each academic program. 

This model, created by Nichols 
and Nichols (2000) is described 
in Appendix A. It depicts each 
program's assessment process in 
a tabular form. While the model's 



adaptation was mandated 
by the central administration, 
the Institutional Effectiveness 
Committee at AUOC provided an 
oversight of its deployment for 
each academic unit. During this 
process, the committee ensured 
that each academic program 
had mission-based, measurable, 
and actionable program 
outcomes; each academic 
program employed direct and 
indirect measures of student 
achievement to triangulate the 
findings; and feedback from the 
assessment process was used to 
improve instruction, planning, 
and budgeting processes (AUOC, 
2004). 

While the central administration 
determined the common 
formats for program outcomes 
and means of assessment, the 
AUOC faculty decided the criteria 
for program success for each 
educational outcome (refer 
to column three of the five- 
column model in Appendix A). 
Furthermore, a clear expectation 
in the mind of the public is that 
institutions are able to document 
not only their plans for 
assessment, but the actual results 
and how these results are used 
to improve programming. Nichols 
and Nichols (2000) suggest that 
"responsibility for maintaining 
this documentation is probably 
best lodged at the departmental 
level" (p. 52). Consequently, the 
faculty at AUOC was responsible 
for summarizing data collected 
during the assessment process 
and for determining how these 
data may improve instructional 
programming and institutional 
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operation (refer to columns 
four and five of the five-column 
model in Appendix A). 

Department Review 

The main purpose of adapting 
the five-column model at 
Argosy University was to 
provide a consistent and 
widely accepted mechanism 
for reporting and analyzing 
assessment results during the 
department review process. 
Historically, department reviews 
have been used to enhance 
the quality of an academic 
program by pointing out its 
strengths and weaknesses and 
by providing recommendations 
for more targeted resource 
allocation (Black & Kline, 

2002). In congruence with that 
mission, the annual department 
review at Argosy University is 
intended to generate explicit 
recommendations for improving 
student success and to guide 
the future direction of the 
campus. Embedded within 
the department review is the 
assessment of student learning 
for each program outcome 
conveyed in the five-column 
model (AUOC, 2004). 

As the result of the 
department review, annual 
action plans must be generated 
for each academic program. 

An action plan contains 
findings and recommendations 
for programmatic learning 
outcomes and indirect measures 
of program success such as 
admissions, persistence, and 
student satisfaction. While the 



five-column model conveys all 
program outcomes for each 
academic unit, only the most 
pivotal items are depicted in the 
departmental action plans (refer 
to Appendix B). 

The evaluation of the 
department review outcomes is 
facilitated by the identification 
of strengths, weaknesses, 
opportunities, and threats 
(SWOTs) for each academic 
program. The purpose of 
the annual SWOT report is to 
convey major departmental 
trends validated by the key 
stakeholders. Additionally, 
if the assessment data are 
to be used for educational 
decisions, their internal impact 
on institutional resources 
must be evaluated (Peterson 
& Vaughan, 2002). To facilitate 
this evaluation, each academic 
unit at AUOC is required to 
generate plans consisting of the 
specific goals, objectives, and 
resource allocation based on the 
departmental SWOT reports. 

Institutional 
Effectiveness Review 

As a means of continuous 
campus-wide quality 
improvement. Argosy University 
has implemented an annual 
institutional effectiveness 
review which consolidates 
the findings of the individual 
reviews for each academic 
department and includes an 
assessment of all campus 
support operations related to 
its academic and strategic goals 
(AUOC, 2004). The institutional 



effectiveness review provides a 
comprehensive and consistent 
evaluation of the current 
strengths and weaknesses of the 
campus and generates specific 
recommendations for the 
improvement of strategic and 
operational campus-wide efforts. 

The assessment of progress 
made on prior year's initiatives 
is pivotal in preparation for 
the institutional effectiveness 
review. Consequently, the AUOC 
Institutional Effectiveness 
Committee was responsible for 
determining the degree of such 
progress and summarizing the 
findings with respect to prior 
year's recommendations. These 
data were used as a starting 
point for establishing the current 
level of departmental progress 
and operations (AUOC, 2006). 

In addition to assessing 
the prior year's progress, the 
institutional effectiveness 
review consists of a thorough 
evaluation of the departmental 
action plans and presentations 
made by each academic 
unit. The purpose of these 
presentations is to facilitate 
discussion among all campus 
stakeholders and to stimulate 
campus-wide dialogue on 
developing recommendations 
that reflect the collective 
campus perspective. For 
instance, after reviewing the 
data presented by various 
academic and functional 
units, the AUOC leaders have 
generated a campus-wide SWOT 
report that consolidated findings 
of the individual departments 
(AUOC, 2006). On the basis of 
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this report, the leadership team 
developed a prioritized list of 
proposed campus objectives 
for the upcoming fiscal year 
and set forth the process 
whereby these objectives are 
translated into specific plans 
including milestones, due dates, 
and responsible parties. This 
process consisted of a two-tier 
plan including the creation of 
departmental project plans 
(refer to Appendix C) and 
the identification of personal 
performance indicators that are 
congruent with departmental 
objectives (AUOC, 2006). 

Lessons Learned 

While responding to the 
external demands provided 
an impetus for the initial 
engagement with programmatic 
assessment at AUOC, the 
formation of the Institutional 
Effectiveness Committee in 
the beginning of the 2005-06 
academic year facilitated the 
development of a sustainable 
internally driven core process of 
inquiry (Maki, 2004) to improve 
student learning. By the end of 
the year, all academic programs 
were engaged in systematic and 
disciplined assessment processes 
including the utilization of an 
assessment template that was 
consistent across programs and 
all delivery media; the adoption 
of program outcomes, measures, 
and rubrics were compliant 
with central staff directives; and 
the department review process 
across campus was standardized. 
To ensure campus-wide support 
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for establishing assessment 
infrastructure, the committee 
membership consisted of 
leaders from each academic 
discipline including the campus 
president. Additionally, the chair 
of the Institutional Effectiveness 
Committee was given release 
time from teaching to ensure 
an appropriate level of focus on 
campus assessment activities. 
While the committee succeeded 
in establishing uniform 
assessment processes across 
academic disciplines, the campus 
faced several challenges during 
the first year of implementation. 

One of the challenges included 
disparate levels of departmental 
readiness to engage in 
effective assessment processes. 
For instance, the graduate 
programs in Business and 
Education and undergraduate 
Psychology program taught 
at the national level had well- 
defined learning outcomes 
and assessment measures 
that were developed as a part 
of a University-wide process. 
Conversely, the development 
of learning outcomes for the 
single-campus programs, such 
as Clinical Psychology, required 
extensive and concerted effort 
from local faculty resulting in 
some difficulties meeting initial 
deadlines. 

Another challenge included 
divergent requirements from 
various accrediting agencies. For 
example, the campus is pursuing 
programmatic accreditation 
through the American 
Psychological Association 



(APA) for the Doctoral program 
in Clinical Psychology. Thus, 
the faculty teaching in the 
program needed to respond to 
reporting requirements enforced 
by the APA in conjunction 
with adhering to the general 
guidelines established by The 
Higher Learning Commission. 
Consequently, the chair of 
the Institutional Effectiveness 
Committee provided additional 
assistance to program faculty 
and administrators to facilitate 
the reconciliation of these 
divergent requirements. 

Despite the above-mentioned 
challenges, the AUOC academic 
leadership was unanimous 
in supporting institutional 
efforts to achieve an externally 
validated Higher Learning 
Commission level three culture 
of assessment and continuous 
improvement. 

Recommendations and 
Implication for Practice 

A major challenge faced by 
assessment practitioners is the 
lack of institutional experience 
in carrying out assessment 
initiatives (Ewell, 2004). This 
article identifies concrete steps 
that may enable institutions 
to integrate assessment into 
their daily operations. These 
steps include: (a) formation of 
an multidisciplinary committee 
signaling the collaborative 
nature of assessment initiatives; 
(b) adoption of standardized 
program outcomes, measures, 
and rubrics for all academic 
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disciplines; (c) utilization of an 
assessment template that is 
consistent across programs and 
delivery media; and (d) adoption 
of departmental review 
processes that demonstrate the 
use of assessment results for 
educational and institutional 
improvements. 

Establishing assessment 
processes that extend across 
campus calls for a collaborative 
beginning (Maki, 2004). At 
AUOC, the formation of the 
Institutional Effectiveness 
Committee ensured a 
collaborative authorship of 
campus assessment practices. 
While the implementation of 
the initial infrastructure was 
completed during the span of 
one academic year, the campus 
intends to evaluate the adoption 
of e-College and Foliotech 
software packages to augment 
its assessment reporting 
capabilities. 

At the present time, a rigorous 
assessment system is in place 
to support effective teaching 
and learning processes. The 
assessment cycle begins with 
the utilization of academic 
program outcomes rooted in 
the University Mission. These 
outcomes are conveyed in a 
five-column assessment model 
that depicts each program's 
assessment process in a tabular 
form. During the annual 
department review process, 
these outcomes are used to 
determine the effectiveness of 
instructional programming. Gaps 
between expected outcomes 



and actual results lead to the 
creation of recommendations 
for continuous improvement in 
student learning. The findings 
of the individual departments 
are consolidated during the 
Institutional Effectiveness 
Review, which identifies 
campus-level objectives. These 
objectives, in turn, influence 
funding decisions during the 
budget process. The Institutional 
Effectiveness Report documents 
much of the institutional process 
and associated work products, 
initiatives, and priorities of the 
assessment cycle. 

Drawing members of an 
educational community together 
to develop a statement of 
institutional commitment 
signals the collaborative nature 
of assessment (Maki, 2004). At 
AUOC, this collaboration was 
facilitated by the formation of 
the multidisciplinary Institutional 
Effectiveness Committee. 
Moreover, such factors as 
the release time given to the 
committee chair to ensure an 
appropriate focus on assessment 
activities and the active support 
of the campus president were 
pivotal in ensuring campus 
success. It is vital to position 
assessment as integral both to 
our professional work and to a 
commitment to teaching and 
learning that is responsive to 
our students' needs (Maki, 2004). 
Without this focus, "assessment 
runs the risk of remaining or 
becoming marginalized. Worse 
yet, it remains an empty and 
intellectually unfulfilling activity" 
(p.15). 
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Appendix A - Abbreviated Five-Column Model 



Argosy University/Orange County 
Assessment Plan — Program Level 
School of Education 

Program: Doctor of Education in Educational Leadership 

Date of last update to repository: 1 0/1 0/05 
Name of person responsible for update: Dina Brown 



ARGOSY 



U N I V E R S 1 T Y 



ORANGE COUNTY 



Overview: The purpose of this repository is to serve as a framework for all academic programs at Argosy 
University/Orange County to ensure that program learning outcomes are defined, measured, met or 
improved. The repository is modeled after Nichols' 5-column assessment plan. 

Abbreviated University Mission Statement: 

Argosy University is a private higher education institution whose mission is to provide high-quality 
education in practitioner fields, employing delivery formats that provide access for students 
regardless of their geographical location. Argosy University offers general education and professional 
programs at the undergraduate, graduate, and postgraduate levels within the behavioral sciences, 
business, education, information technology, and healthcare fields. These degree programs are 
designed to instill the knowledge and skills of professional practice as well as foster the values of 
higher education and social responsibility. 

Abbreviated School Mission Statement: 

The mission of Argosy University's College of Education and Human Development is to prepare 
leading educational practitioners and lifelong learners who actively engage in the scholarships of 
discovery, application, integration and teaching, within diverse educational environments. Graduates 
of Argosy University's College of Education and Human Development possess the advanced 
knowledge base, skills, and dispositions that characterize confident and principled educational 
leaders who are ethical practitioners, effective communicators, productive collaborators and well 
informed consumers, synthesizers, and evaluators of educational research. As such, their practice 
reflects awareness of social issues, commitment to social justice, and sensitivity and responsiveness 
to all facets of a pluralistic society. 

Programmatic Statement of Purpose: 

The Doctor of Education in Educational Leadership prepares individuals for either higher education 
or K-1 2 leadership positions. The program is designed to instill knowledge and skills related to the 
professional practices associated with educational leadership including policy issues, administrative 
theory and practice. The faculty of the Doctor of Education in Educational Leadership program 
considers assessment of student learning to be integral to their educational operations and regard 
assessment findings as a source of knowledge essential for continuous improvement in instructional 
and programmatic offerings. 
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Programmatic Learning Outcome Assessment and Continuous Improvement 
Repository: 


Program Intended 


Program 


Means of program 


Summary 


Use of results 


Educational 

Outcomes 


Competencies 


assessment and criteria for 
success (direct/ indirect 
measures) 


of Data 
Collected 




Research and Theory 


Analyze, design. 


Internship, Dissertation, 


la. Mean score 


Continue with previous 




conduct, and defend 
research in an 
educational context 
using action research 


Comprehensive Examination 

la. Combined dissertation 
rubric mean score (0 to 3) for 


(0 to 3) = 2.95 


recommendations regarding this 
outcome: 

• Embed research outcomes 
across courses 




and other appropriate 


sections A, B, E, and F will be 


1b. Mean score 


• Embed classroom activities 




designs. 


equal to or greater than 2.5 

1 b. Comprehensive exam 
rubric mean score (0 to 4) for 
relevance will be equal to or 
greater than 2.5 


(0 to 4) = 3.1 25 


that incorporate professional 
research and opportunities 
• Incorporate research concepts 
and theory in classroom 
discussions and content 


Communication 


Orally or in writing. 


Dissertation, 


2a. Mean score 


1 . Consider establishing a writing 


and Informational 
Literacy/ Oral 


present educational 
documents (including 


Comprehensive Examination 


(0 to 3) = 2.86 


portfolio program, wherein the 
student would create a portfolio 


and written 


recommendations. 


2a. Combined dissertation 




based on writing samples 


communication 


critiques or 


rubric mean score (0 to 3) for 




throughout her career as a student 




justifications) that are 


sections D, L, and M will be 


2b. Mean score 


at Argosy. Development of the 




clear, concise, organized 
and well supported in 
a professional manner 
using media appropriate 
to the education 
context and audience, 
using appropriate media 
and technology. 


equal to or greater than 2.5 

2b. Combined comprehensive 
exam rubric mean score (0 to 4) 
for grammar, punctuation, and 
APA adherence will be equal to 
or greater than 2.5 


(0 to 4) = 2.92 


portfolio program would take 
place through faculty dialogue 
and meetings. 

2. Hold Workshops for the faculty, 
addressing current issues in 
writing and communications. 
Include updated information on 
APA writing, style and format. 


Critical Thinking- 


Analyze contemporary 


Dissertation, 


3a. Mean score 


Faculty recommend the following: 


Problem Solving 


theoretical concepts at 
all levels of educational 
leadership, in design, 
implementation, and 


Comprehensive Examination 

3a. Combined dissertation 
rubric mean score (0 to 3) for 


(0 to 3) = 2.92 


1 . Embed critical thinking skills 
learning outcomes throughout 
core courses. 

2. Identify specific courses in 




evaluation of personnel 


sections C, H, l,J,and M will be 


3b. Mean score 


which this learning outcome 




preparation programs 
at pre-service and in- 
service levels. 


equal to or greater than 2.5 

3b. Combined comprehensive 
exam rubric mean score (0 to 4) 
for organization and cogency 
will be equal to or greater than 
2.5 


(0 to 4) = 3.39 


needs to be emphasized. 

3. Train faculty in instructional 
approaches. 

a. Create platform in the 
classroom for students to critically 
analyze, evaluate and synthesize 
pertinent material. 

b. Review case studies and 
literature for critical analyses and 
evaluation. 
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Appendix B - Abbreviated Departmental Action Plan 



DEPARTMENT REVIEW ACTION PLAN 
Program: Doctor of Education in Educationai Leadership 

Campus: Orange County Date of Review January 12,2006 



Learning Outcome #1 

Communication and Information Literacy/Oral and Written Communication 

Present educational documents that are clear, concise, organized, and well-supported using appropriate media and technology. 



Summary of Faculty Findings 
Summative scores: 

Dissertation 

2a. Combined dissertation rubric mean score (0 to 3) for sections D, L, and M will be equal to or greater than 2.5 
2a. Mean score (0 to 3) = 2.86 

Comprehensive Examination 

2b. Combined comprehensive exam rubric mean score (0 to 4) for grammar, punctuation, and APA adherence will be equal to or 

greater than 2.5 

2b. Mean score (0 to 4) = 2.92 

Current baseline criterion scores are the first attempt at creating measurable learning outcomes. Since baseline scores were 
determined with a minimal amount of previous data, faculty agreed that although mean scores exceeded criterion baseline 
score, there remains considerable potential for improvement in this learning outcome. 

For instance, the quality of students' written communication presented in a clear, concise, organized, and well-supported 
manner Is inconsistent across assignments. Faculty are frequently unable to determine writing and information literacy skills' 
progress across the program. Furthermore, faculty expressed awareness that there is an inconsistency in presentation of APA 
standards. 



Recommendations to Improve Student Learning in this Outcome: 

Faculty recommend the following: 

1 . Consider establishing a writing portfolio program, wherein the student would create a portfolio based on writing samples 
throughout her career as a student at Argosy. Development of the portfolio program would take place through faculty dialogue 
and meetings 

2. Hold Workshops for the faculty, addressing current Issues in writing and communications. Include updated information on 
APA writing, style, and format. 

3. Embed a standardized rubric for written and oral communication in all relevant courses 

a. Teach faculty on use of these rubrics 

4. Standardize APA expectations by accomplishing the following: 

a. Adopt an APA rubric for use in all courses 

b. Hold workshops for faculty on APA format and style to ensure quality instruction. 

c. Work in collaboration with the writing coordinator/student resource center to ensure that students are receiving the 
help needed 

5. Establish effective learning/writing center and tutors to meet student needs 
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Appendix C - Abbreviated Project Plan 

ARG^^SY 

U N I V E RfS I T Y 

1 !' 

Departmental Action Plan ORANGE county 



Association for 
Institutional Research 




Department Name: 


School of Education Doctoral Programs Plan #3 


Person Completing This Plan: 


Program Chair 


Date completed: 


6-6-06 



Instructions: 

During the Department and/or Institutional Effectiveness Review, your department (faculty/staff) suggested some 
recommendations for improvement for FY07. The purpose of this template is to take the most important recommendations and 
translate them to a plan of action... complete with tasks, persons responsible for completing those tasks and deadlines. 

The emphasis of this should not be on campus level initiatives. Rather, your focus should be on pulling out the top initiatives 
from your department review(s) that you believe must receive your department's attention for FY07. One of the outcomes of this 
process should be that when we go through the Department Review process in the Spring of 2007, we should have fewer "we 
didn't do anything about this recommendation" types of comments. 



FY07 INITIATIVE ACTION PLANNING TEMPLATE 


Please use the space to the right to place the 
recommendation from your department review that you will 
focus on in this template: 


Hold Workshops for the faculty, addressing current issues 
in writing and communications specific to the School of 
Education Doctoral Programs. Include updated information on 
APA writing, style and format. 


Please use the space to the right to define what the intended 
outcome of this action plan will be. In other words, how 
will you know that the plan you create below will have its 
intended results? What will improved performance look like? 


Program Learning Outcome scores will improve as a result of 
these actions: 

Current Score: Mean score (0 to 3) = 2.86 
Objective: Mean Score (0-3) = 2.90 


Summary Action Plan 


Task 

Number 


In order to improve performance, we need to 
engage in the following tasks (list them below) 


And this person is on point to 
complete these tasks (list below 
and align to tasks to the left) 


By this date (create deadlines 
below that align to the tasks 
in the left hand column) 


1 


Hold workshops twice per year addressing written 
communication, APA style and dissertation-specific 
issues in the SOE Doctoral Programs. 


Program Chair 


October 1 st, 2006 
March 15th, 2007 


2 


Conduct interactive workshops/faculty meetings 
where faculty is working in teams to identify and 
create solutions to writing assignment problems 
specific to the School of Education Doctoral 
Programs. For example, assignments involving 
literature review will be examined across faculty, 
course and assignments. 


Program Chair 


October 1 st, 2006 
March 15th, 2007 
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